Relative Surprisal Index

Researchers introduced the Relative Surprisal Index (RSI), an information-theoretic metric that balances token probability and entropy to improve reinforcement learning for large language models. The …